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Automated Color Property Adaptation 
In Computer Output Devices 

Field Of The Invention 

[00011 The invention is directed toward outputting image data on an output 
device, and more particularly to automating color property adaptation for the output 
device, and more particularly to distributing the computational load for the color 
property adaptation to the output device. 

Related Application 

[00021 This application is a Continuation In Part (CIP) Application of U.S. 
Patent Application No. 09/457,703, filed December 9, 1999, the entirety of which is 
hereby incorporated by reference. 

Background Of The Invention 

F00031 Digital image data can be generated relative to various color spaces, 
e.g., standard Red Green Blue (sRGB) (standardized by International 
Electrotechnical Commission (IEC) 61966-2-1), National Television Standards 
Committee (NTSC), Phase Alteration Line (PAL), SEquential Color And Memory 
(SECAM), etc. But the color space of the source of the image data is very often not 
the color space of the output device (such as a monitor, printer, projector, etc.) that 
converts the image data into a visually perceptible analog thereof. In other words, 
where the source of the image data operates in a first color space and the output 
device operates in a second color space, it is usually desirable to convert the image 
data from the first color space to the second color space before outputting it via the 
output device. 

[00041 Typically, the Background Art (such as in Fig. 1) has performed the 
color space (CS) conversion in the Central Processing Unit (CPU) of a computing 
device (such as a personal computer), not in the output device. Fig. 1 depicts a block 
diagram of a personal computer system according to the Background Art. 
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r00051 In Fig. 1 , a personal computer (PC) 100 is depicted as including a CPU 
102 and an output device 106 connected to the CPU 102 by signal path 114. Fig. 1 
also depicts a source of image data 108 connected to the CPU 102 by the signal 
paths 110 and 112. The CPU 102 has a color space (CS) conversion module 104 
that performs the function of converting image data from a first color space to a 
second color space. Thus, CS conversion module 104 is depicted as the termination 
point for the signal paths 110 and 112. The output device 106 is depicted as taking 
the form of a monitor 106A that is a component of the PC or as a printer 106B that is 
external to the PC. Each of the monitor 106A and the printer 106B is considered 
external to the CPU 102. 

r00061 In operation, the image data source 108 provides image data based in 
the first color space (CS1) and tag data representing parameters of the first color 
space via signal paths 110 and 112, respectively, to the CS conversion module 104 
within the CPU 104 of the PC 102. Then, the CS conversion module 104 
automatically converts the image data from the first color space to the second color 
space (CS2) according to the tag data for the first color space. And then the CS 
conversion module 104 outputs the image data based in the second color space to 
the output device 106 via the signal path 114. 

r00071 It is noted that separate signal paths 110 and 112 for the image data 
and the associated tag data, respectively, have been depicted to emphasize that tag 
data is transferred to the CPU 102, while, in contrast, only CS2 image data is 
transferred out of the CPU 102 over the signal path 1 14. But it is not necessary that 
the image data and tag data be transmitted over two separate paths. 
[00081 The CS conversion module 104 is typically implemented as software 
being run by the CPU 102. As such, the conversion speed of the software is limited 
by the system clock speed of the CPU 102. This raises the problem that the CPU, in 
general, cannot convert moving picture images (e.g., 100 million pixels per second) 
fast enough so that the moving pictures can be displayed on the output device (here, 
the monitor 106A) in real time. 
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roQQ91 The PC 100 of Fig. 1 has another problem. Suppose that it has to drive 
a second output device (not depicted), e.g., a liquid crystal display (LCD) projector, 
which is a typical requirement of a laptop PC. If the color space of the second output 
device is different than the color space (CS3) of the monitor 106A, the color 
conversion module 104 will attempt to convert the original image data from the 
source 108 into both CS2 image data and CS3 image data concurrently. For all but 
the smallest of image data sets, this represents a computational load that cannot be 
serviced in real time by the CS conversion module 104, i.e., the CPU 102. As a 
result, the monitor 106A and the second monitor cannot display the same image 
concurrently in real time. 

[00101 As represented by a computer monitor (not depicted) marketed by the 
MITSUBISHI ELECTRIC CORPORATION ("Mitsubishi Denki"), Model No. LXA580W, 
it is known in the Background Art to locate non-automatic color conversion 
functionality in an output device. Such a monitor includes a memory containing 
conversion circuitry to convert input image data from one of a plurality of color spaces 
into the color space of the monitor. 

[00111 A viewer/user of the Background Art monitor marketed by Mitsubishi 
Denki can manipulate a dedicated interface on the front of the monitor case to select 
one of the plurality of color spaces. Processing circuitry within the monitor 
accordingly will treat the input image data as if it has been generated within the 
selected color space. The processing circuitry will convert the input image data from 
the selected color space into the color space of the monitor. Then, the converted 
image data is displayed. The viewer/user views the displayed data to decide if its 
appearance is acceptable. Through trial and error, the conversion resulting in the 
best display appearance (according to the viewer's/user's personal preferences) can 
be selected. 

r00121 The Background Art monitor marketed by Mitsubishi Denki has the 
advantage of providing enhanced quality of the displayed image. But it has the 
disadvantage that the user/viewer must actively participate in the optimization 
process each time data from a different color space is to be displayed. 
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Summary Of The Invention 

f0013l The invention, in part, provides a method (and computer system 
embodying the method) of displaying original image data that was generated relative 
to a first color space by an output device that converts image data of a second color 
space to a visually-perceptible analog thereof. Such a method comprises: receiving 
from a provider, over a communication channel, original image data that was 
generated according to a first color space; receiving from the provider, over a 
communication channel along with the image data, tag data representing parameters 
of the first color space; the output device automatically converting the original image 
data into the second color space according to the tag data to produce converted 
image data; and the output device converting the converted image data into a 
visually-perceptible analog thereof. 

[00141 The invention, also in part, provides a method (and computer system 
embodying the method) of displaying original image data that was generated relative 
to a first color space by an output device that converts image data of a second color 
space to a visually-perceptible analog thereof. Such a method comprises: receiving 
from a provider, over a communication channel, original image data that was 
generated according to a first color space; monitoring the presence of tag data, 
representing parameters of a color space, over the communication channel along 
with the image data; presuming, if no tag data is received over the communication 
channel, that the first color space is a default color space; the output device 
converting the original image data into the second color space based upon the 
presumption that the first color space is the default color space to produce converted 
image data; and the output device converting the converted image data into a 
visually-perceptible analog thereof. As an example, the default color space can be 
sRGB. 

r001 51 The invention, also in part, provides that the data provider can be a 
computing device and the communication channel can be a direct connection 
between the computing device and the output device, or that the provider can be a 
memory device and the communication channel can be a direct connection between 
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the memory device and the output device, or that the provider can be a server and 
the communication channel can be a network to which the output device is 
connected. Alternatively, the invention provides that the output device can be a 
component of a personal computing device connected to the network, and such a 
network connection can be wireless. 

r00161 The invention, also in part, provides that the provider receives the 
original image data from a source, e.g., a scanner, a digital camera or a signal 
generator, and that the output device can be a monitor, a projector or a printer. 
[00171 Advantages of the present invention will become more apparent from 
the detailed description given hereinafter. However, it should be understood that the 
detailed description and specific examples, while indicating preferred embodiments of 
the invention, are given by way of illustration only, since various changes and 
modifications within the spirit and scope of the invention will become apparent to 
those skilled in the art from this detailed description. 

Brief Description of the Drawings 

r001 81 The present invention will become more fully understood from the 
detailed description given hereinbelow and the accompanying drawings which are 
given by way of illustration only, and thus do not limit the present invention. 
[00191 Fig. 1 depicts a block diagram of a personal computer system 
according to the Background Art. 

r00201 F i g. 2 dop i cts Figs. 2A and B depict a block diagram of a first 
embodiment of a computer system according to the invention. 
[00211 Fig. 3 depicts a block diagram of a second embodiment of a computer 
system according to the invention. 

r00221 Fig. 4 depicts a block diagram of a third embodiment of a computer 
system according to the invention. 

r00231 Fig. 5 depicts a color conversion module according to the invention in 
more detail. 
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r00241 And Fig 6 depicts a block diagram of a fourth embodiment of a 
computer system according to the invention. 
[00251 The drawings are not drawn to scale. 

Detailed Description of the Preferred Embodiments 

r00261 F i g. 2 depicts Figs. 2A and B depict a block diagram of a first 
embodiment of a computer system according to the invention. In F i g. 2 Figs. 2A and 
B, a computing device, such as a personal computer (PC) 200, includes a CPU 202 
and an output device 206. Fig. 2 Figs. 2A and B also dopiots depict an image data 
provider 215 that includes a source 108 of image data, optionally connected to the 
CPU 202 via a network 218 run by a server 220 (the network 218 and the server 220 
being drawn in dashed lines to denote their optional status). The source 108 of image 
data can be, e.g., a scanner, a digital camera or a signal generator (such as paint, 
photo, graphics or animation software). 

r00271 The image data provider 215 is connected to the CPU 202 via signal 
paths 110 and 112. The CPU 202 is connected to the CS conversion module 204 via 
signal paths 208 and 210. 

f00281 The output device 206, not the CPU 202 (as in the Background Art of 
Fig. 1 ), has a color space (CS) conversion module 204 that performs the function of 
converting image data from a first color space to a second color space. The CS 
conversion module 204 corresponds to the CS conversion module 506 of Fig. 5 
(which is depicted in more detail); the CS conversion module 506 is discussed in 
more detail below. 

r00291 The output device 206 is depicted as including a converter to convert 
image data into a visually-perceptible analog thereof, such as a monitor 206A that 
can bo a componont of th o PC or a pr i nter 206B that can bo oxtornal to tho PC. Tho 
CS conv e rs i on modu l o 204 i s connoctod to tho converter 206A and/or 206B v i a 
s i gna l path 214. . a printer 206B. or projector 206C, as shown in Fig. 2B. 
r00301 Each of the monitor 206A and the printer 206B, as well as the CS 
conversion module 204, are considered external to the CPU 202. The monitor 206A 
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can be a cathode ray tube (CRT), a liquid crystal display (LCD) device, a plasma 
display panel (PDP), an LCD project, etc. The printer 206B can be a laser printer, an 
ink jet printer, a dot matrix printer, a thermal printer, a plotter, etc. 
r00311 Separate signal paths 208 and 210 for the image data and the 
associated tag data, respectively, have been depicted to emphasize that the tag data 
is transferred to the CS translation module 204 , wh il o, in contrast, tho s i gnal path 214 
convoys on l y CS2 i mago data to tho converters 206A and/or 206B . Similar 
conventions have been employed in the other figures. But it is not necessary that the 
image data and tag data be transmitted over two separate paths. Rather, the number 
of signal paths will depend upon the application in which the invention is employed. 
r00321 Fig. 3 depicts a block diagram of a second embodiment of a computer 
system according to the invention. The differences between Fig. 3 and Fig. 2 Figs. 
2A and B will be emphasized. In Fig. 3, the image data provider 300 can be a 
network 302 run by a server 304. A network-compatible output device 306, having a 
CS conversion module 204, is connected to the network 302 via the signal paths 208 
and 210. 

r00331 Fig. 4 depicts a block diagram of a third embodiment of a computer 
system according to the invention. The differences between Fig. 4 and Fig. 2 will be 
emphasized. In Fig. 4, the image data provider 406 can be a wireless network 408 
run by a server 410. And the computing device 400 (e.g., a personal data assistant 
(PDA)) includes an antenna 401 , a wireless interface 402 and a CPU 404. 
r00341 In Fig. 4, the antenna 401 of the computing device 400 is connected to 
the image data provider 406 via the wireless signal paths 414 and 416. The wireless 
interface 402 is connected to the antenna 401 via the signal paths 418 and 420. The 
wireless interface 402 is connected to the CPU via the signal paths 422 and 424. The 
CPU 404 is connected to the CS conversion unit 204 via the signal paths 208 and 
210. Tho CS convors i on un i t i s oonnoctod to tho converter 206A and/or and 206B v i a 
tho signa l path 214. 

[00351 Fig. 5 depicts, in more detail, a CS conversion module 506 according to 
the invention. The CS conversion module 506 . which is provided in the output 
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device 518. corresponds to the CS conversion module 204. In Fig. 5, an image data 
provider 502 is connected to the CS conversion module 506 via a communication 
channel 504 through which travel signal paths 208 and 210. 

rOQ361 The CS conversion module 506 includes a unit 510 to process the 
image data , tho procossod i mago data bo i ng output to an output dov i co 518 
(corrosponding to tho var i ous ombodimonts 206 and 306 of output dov i cos d i scussed 
abov e ) . The CS conversion module also includes unit 508 to set the parameters for 
the processing unit 510 and an optional memory device 522 (denoted by depiction in 
dashed lines), e.g., a ROM, connected to the unit 508. The processing unit 510 
includes: a unit 512 to process the input image; a unit 514 to convert the color of the 
input image data; and a unit 516 to process the output. The unit 512 includes a tone 
conversion module 520 to manipulate the tone of the input image. The unit 516 
includes a tone conversion module 522 to manipulate the tone of the output image. 
f00371 The units 508, 512, 514, and 516 are preferably hardware devices such 
as Programmable Logic Arrays (PLAs) or Application Specific Integrated Circuits 
(ASICs). And the units 508, 512, 514, and 516 are the subject of the following 
copending patent applications, the contents of each of which is hereby incorporated 
by reference: unit 508 is the subject of Japanese Patent Application Nos. Heisei 11- 
291896, Heisei 11-291897, Heisei 11-349716 and Heisei 11-349717; unit 512 is the 
subject of Japanese Patent Application Nos. Heisei 11-291892 and Heisei 11- 
291894; unit 514 is the subject of the parent of the parent to this case, namely U.S. 
Patent Application No. 09/457,703; and unit 516 is the subject of Japanese Patent 
Application Nos. Heisei 11-291893 and Heisei 11-291895. 

[00381 Tag data representing parameters of a color space can take many 
forms, depending upon the particular details of the units 508, 510, 512, 514 and 516. 
Some examples of tag data follow. Tag data can be a code (e.g., 3 bits in length) 
identifying a type of color space such as sRGB, NTSC, PAL, SECAM, a proprietary 
standard used by a manufacturer of image generating equipment, etc. Tag data can 
be primaries' coordinates, e.g., R: (x, y)=(0.640, 0.330), G: (x, y)=(0.300, 0.600), B: 
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(x, y)=(0.150, 0.060); or W: (x, y)=(0.3127, 0.3290), x, y: CIE (Commission 
Internationale de l'£clairage) chromaticity coordinate. 

rrjQ391 Tag data can be tone characteristics, e.g., a gamma value such as 
gamma=1 .8 or 2.2 or 2.6. Tag data can be a table of values for tone conversion, e.g., 
that describe a relationship between input signal level and output signal level, such 
as 



input 


0.0 


0.1 


0.2 




0.9 


1.0 


output 


0.0 


0.01 


0.04 




0.81 


1.00 



r00401 Tag data can also be a combination of primaries' coordinates and tone 
characteristics. 

r00411 Tag data can be color reproduction characteristics related to human 
perception, e.g.: RGB signal values for specific colors such as: Red, R=1.0, G=0.1, 
B=0.0; or Hue (similar to color phase), Chroma (similar to saturation), and Value 
(similar to brightness) coordinates for specific colors such as, in the case of absolute 
values, Red -- Hue =5, Chroma=4, Value=14, or the case of relative values, Red - 
delta_H = 0.1, delta_C = - 0.01, delta_V = 0.0. Tag data can also be parameters for 
processing unit 510, especially the tone conversion unit 520, the color conversion 
unit 514 and the tone conversion unit 522. 

r00421 It is noted that the order of discussing the various forms of tag data also 
indicates a relative increase in the size of memory needed to store the tag data. 
r00431 Fig 6 depicts a block diagram of a fourth embodiment of a computer 
system according to the invention. The differences between Fig. 6 and Fig. 2 Figs. 
2A and B will be emphasized. In Fig. 6, the image data provider 600 can be a 
memory device 602 such as a Personal Computer Miniature Communications 
Interface Adapter (PCMCIA) memory card, a disk drive device or other memory 
device. The image data provider is connected to the CPU 202 via the signal paths 
110 and 112. Again, the CPU 202 is connected to the CS conversion module 204 via 
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the signal paths 208 and 210 while the CS conversion module is connected to the 
converter 206A and/or 206B via the signal path 214. 

[00441 The operation of the various embodiments will now be discussed. 
r00451 In F i g. 2 Figs. 2A and B . the image data provider 215 provides image 
data based in a first color space (CS1) and tag data representing parameters of the 
first color space via signal paths 1 1 0 and 1 12, respectively, to the CPU 202 of the PC 
200. The CPU 202 transmits the CS1 image data and the tag data, without 
conversion (in contrast to Background Art Fig. 1), to the CS conversion module 204 
within the output device 206 via signal paths 208 and 210, respectively. Then, the CS 
conversion module 204 automatically converts the CS1 image data from the first 
color space to the second color space (CS2), namely that of the converter 206A 
and/or 206B, according to the tag data for the first color space. And thon th o CS 
conv e rs i on modu le 204 outputs th e i mago data, now based i n the s e cond Golor 
spaco, to tho converter 206A and/or 206B v i a tho signa l path 21 A . 
m0461 I f tho PC 200 has both a default mon i tor 206A and a pr i nter 206 B, thon 
each Each of the monitor 206A and the printer 206B can hav e has its own CS 
conversion unit 204A and 204B, respectively mot dop i ctod for s i mp li c i tv W as shown 
in Fig. 2B) . Similarly, if another output device 206i is provided (not depicted), it too 
will have its own CS conversion module 204i. 

r00471 Similarly, in Fig. 5, the CS conversion module 506 automatically 
converts the CS1 image data from the image data provider 502 to the second color 
space (CS2) of the output device 518 according to the tag data for the first color 
space. And th e n tho CS convers i on modu l o 506 outputs tho i mago data, now bas e d 
i n tho s e cond co l or spaco, to tho output d o v i o o 518. For a more detailed description 
of the operations of the units 508, 510, 512, 514, and 516, the reader is generally 
referred to the copending applications that have been incorporated by reference 
above. 

r00481 An alternative implementation of the CS conversion module 204 is 
indicated with the optional memory device 522 depicted in the corresponding CS 
conversion module 506 of Fig. 5. In this alternative implementation, the unit 508 (for 
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setting parameters) monitors the signal path 210 for tag data. If none is received 
within a predetermined time relative to the transmission of the image data over the 
signal path 208, then the unit 508 presumes that the color space of the image data 
corresponds to a default color space. The memory device 522 contains parameters 
that are representative of the default color space. The unit 508 causes the default 
parameters in the memory device 522 to be transferred to the process unit 510. As 
an example, the default color space can be sRGB. 

r00491 As a further alternative, instead of the tag data (representative of 
parameters of a color space) being transmitted to the unit 508 via the signal path 
210, the parameters themselves for the color space could be transmitted to the unit 
508 from the data image provider 502. But this alternative will consumer a greater 
communication bandwidth. 

[00501 In Fig. 3, the CS1 image data and associated tag data are transmitted 
by the image provider 300 over the signal paths 208 and 210, respectively, from the 
server 304 via the network 302. The output device 306 is capable of interfacing to the 
network 302. The operation of the CS conversion module 204, etc., remains 
substantially the same. 

f0051l In Fig. 4, the data provider 406 transmits CS1 image data and its 
associated tag data over wireless signal paths 414 and 416, respectively, to the 
antenna 401 under control of the server 410 via the wireless network 408. The 
wireless interface 402 of the computing device 400 receives the CS1 image data and 
its associated tag data via the signal paths 418 and 420, respectively. The wireless 
interface 402 transfers the CS1 image data and its associated tag data to the CPU 
404 via the signal paths 418 and 420, respectively. The CPU 404 transfers the CS1 
image data and its associated tag data via the signal paths 208 and 210, 
respectively, to the CS conversion module 204 within the output device 206. Again, 
the operation of the CS conversion module 204, etc., remains substantially the same. 
[00521 In Fig. 6, the image data provider 600, e.g., the memory device 602, 
provides image data based in a first color space (CS1) and tag data representing 
parameters of the first color space via signal paths 110 and 112, respectively, to the 
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CPU 202 of the PC 200. The operation of the CPU 202, etc., remains substantially 
the same as in Fig. 2. 

K)0531 Some advantages of the invention will be discussed. By moving the CS 
conversion module to the output device, the invention relieves the CPU of the burden 
of having to convert image data of a first color space into a second color space. This 
makes it possible for computing devices equipped with this technology to display 
moving pictures that, by contrast, cannot be displayed according to the Background 
Art. And by making the conversion automatic by way of passing the tag data to the 
CS conversion unit, the invention relieves the viewer/user of having to optimize the 
settings of the output device each time the color space of the inputted image data 
changes. 

r00541 Further, by having the CS conversion modules moved to the output 
devices, a computing device according to the invention can drive multiple output 
devices (that are designed to different color spaces) concurrently. And the multiple 
output devices can convert the image data into visually perceptible analogs thereof 
concurrently in real time. 

r00551 The invention achieves output device independence for the CPU. In 
other words, the transfer of image data by a CPU to an output device can take place 
in an object-oriented manner, i.e., without the need for the CPU to adapt the image 
data to particularities of the output device. Conversely, output devices according to 
the invention achieve image data source independence, i.e., the output device can 
display image data from any color space (defined for the output device in advance) 
without the need to receive image data converted to the color space of the output 
device. 

[00561 The invention being thus described, it will be obvious that the same 
may be varied in many ways. Such variations are not to be regarded as a departure 
from the spirit and scope of the invention, and all such modifications as would be 
obvious to one skilled in the art are intended to be included within the scope of the 
following claims. 
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